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We study spin and charge susceptibilities in the d-wave superconducting state whose underlying electronic 
dispersion is anisotropic due to the formation of the electronic nematic order. We show that the amplitude of the 
incommensurate peaks in the spin susceptibility near (tt, tt) reveals a pronounced anisotropy in the momentum 
space. The relevance of our findings to the magnetic scattering pattern observed in recent neutron scattering 
measurements on untwinned YBa2Cu306+a: is discussed. In the charge channel, we identify a well-defined 
collective mode at small momentum transfer with strong anisotropic amplitude depending on the direction of 
momentum transfer, which is associated with the broken symmetry due to nematic ordering. 
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I. INTRODUCTION 

It has been recently proposed that quantum analog of liq- 
uid crystal states - dubbed as electronic smectic and nematic 
phases - may play an important role in physics of strongly cor- 
related systemsjiiSii^i^ The smectic and nematic phases are 
characterized by the broken uni-directional translational and 
rotational symmetry, and broken rotational symmetry, respec- 
tively. When electrons reside on a lattice, the broken trans- 
lational and rotational symmetries correspond to the broken 
point group symmetry of the underlying lattice. For example, 
the electronic nematic phase is characterized by the broken 
X — y symmetry on a square lattice, and the collective modes 
associated with the broken symmetry. The direct or indirect 
evidences of electronic smectic and nematic phases has been 
reported in various strongly correlated systems, via different 
experimental techniquesi^iii^i^iiSiS 

In particular, a recent neutron scattering measurement on 
untwinned YBa2Cu306+a; have indicated the possibility of a 
nematic liquid phase in high temperature superconductors.'" 
Neutron scattering experiments, which provide direct infor- 
mation on the spin dynamics as well as static magnetic order, 
have been widely and successfully used to understand novel 
phenomena in high temperature superconductors. However, 
theoretical interpretations of the origin of incommensurate 
spin excitations observed by neutron scattering experiments 
are still controversial." One explanation of this phenomenon 
is that it is due to Fermi surface nesting»i^ However, it was 
also proposed that this phenomena can be understood due to 
the formation of one dimensional stripes in the system.' *^ A 
recent neutron experiment'" shows that the spin fluctuations 
in this material are indeed of two-dimensional nature: the 
locus of maximum spin fluctuation spectral weight approxi- 
mately forms a circle in the momentum space. However, there 
exists a strong anisotropy in the amplitude and the width of 
the incommensurate peaks depending on the direction of the 
momentum transfer These experimental results may indicate 
that the electronic structure in the high temperature supercon- 
ductors is neither rigid one-dimensional stripe arrays, nor an 
isotropic two dimensional system. 

In this paper, we study incommensurate spin and charge 
fluctuations in d-wave superconducting state which coexists 
with electronic nematic phase. We find the strong inten- 



sity anisotropy in the incommensurate spin susceptibility near 
(tt, tt) is due to the anisotropic band structure of the nematic 
phase. The incommensurabilities and the width of the in- 
commensurate peaks also show anisotropy in the momen- 
tum space. The qualitative results bear a resemblance to the 
magnetic scattering pattern observed in the neutron scatter- 
ing measurements. '"■''' We also study the charge dynamics, 
especially focus on the effects of coupling to the collective 
modes. We find that a pronounced peak appears at moder- 
ate energies for small momentum transfer This peak is an 
overdamped collective mode of the amplitude fluctuations at 
extremely small wave-vectors and grows into a sharp mode at 
moderate finite wave-vectors. The intensity of this mode also 
shows anisotropy in the momentum plane, which results from 
the broken x — y symmetry of the nematic order 

This paper is organized as follows. In the following sec- 
tion, we describe the nature of nematic order, and introduce 
an effective Hamiltonian for the nematic transition within the 
weak coupling theory. We also give a brief summary for com- 
pleteness the mean field results of the effective Hamiltonian 
presented previously.''* '^ We present spin and charge suscep- 
tibilities in the superconducting state which occurs on top of 
the nematic phase in Secs.llUland llVI respectively. The con- 
nection to experimental observations is discussed in Sec.lVl 
The conclusion and summary are given in Sec. lVIl 

II. MODEL 

For classical liquid crystals, the nematic order parameter 
is represented by a director, which is a quadrupolar ( rank- 
two symmetric traceless ) tensor built from the spatial di- 
rections. In two dimensions, it changes sign under a rota- 
tion by 7r/2 and is invariant under a rotation by vr. In sim- 
ilar spirit, one can construct a quadrupolar order parame- 
ter for electronic systems using the momentum operators of 
electrons, Qij — piPj — ^p^Sij. The attractive interaction 
between quadrupole densities can lead to the nematic order 
which breaks the rotational symmetry, and a preferred direc- 
tion for the electron momenta occurs. 

Within the weak coupling theory, the following effec- 
tive Hamiltonian of quadrupole-quadrupole density interac- 
tion has been proposed to describe the transition between 
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isotropic liquid to the nematic ordered phase'"* '^''^, where the 
expectation value of quadrupole density serves as the order 
parameter of the nematic phase. 



-E^2(q)(Tr[Qt(q)Q^(q)]) , 



(1) 

where = — 2t(cos k^+cos ky) — 4t' cos cos fey — /i is the 
bare electronic dispersion. F2(q) is a short-range attractive 
interaction, which can be written in a general form as 



1 + KF2q^ ' 

where F2 > 0. Q{q) is the quadrupole density tensor, 

fF{k,q) G{k,q)' 



k+q.'^ \G{k,q) F{k,q) 



(2) 



where F{k,q) — [(cosfc^: — cos ky ) + {cos{kx + qx) — 
cos{ky + qy))]/2, and G{k, q) — [(sin k^ sin ky) + (sin(fc:r + 
qx)sin{ky + qy))\l2. Notice that Q'^ (q) — (5(—q), indicating 
that Q{r) is Hermitian. 

The mean field solution is akeady presented in Ref. '14^151 
and we give a brief summary of the result here for complete- 
ness. To solve the model at the mean field level, we decouple 
the interaction at q ^ and define two order parameters. 



Aat = F2{QxM) = F-2Y,fi^k)F{k), 

k 

A'^ = ^^2(Q.,(0)) =F2^/(efc)G(fc), 



(3) 



where F{k) — {coskx — cos ky) and G{k) — sinkx sinky. 
The electron dispersion in the nematic phase is renormahzed 
to 



-2t{l + AN/2t) coskx - 2t{l 
-At' cos k-r cos k, 



A'j^ sin kx sin ky 



A]y /2t) cos ky 
11. (4) 



Non-zero values of Aat and A'^ indicate the lattice rotational 
symmetry is broken and there exists a preferred direction for 
the electron momentum. At the mean field level, with a sin- 
gle value of F2, it is found that A'^ always vanishes, which 
indicate the deformation of the Fermi surface is along the un- 
derlying lattice axes. It is also found that Aat jumps at the 
transition from the isotropic phase to the nematic phase by 
tuning the chemical potential and/or the strength of interac- 
tion, which leads to a dramatic change of the Fermi surface 
topology - a closed to an open Fermi surface - at the transi- 
tion. Therefore, the nematic ordered state describes electrons 
with anisotropic hopping and the topology of the Fermi sur- 
face changes dramatically at the transition. '"^ '^ 

Fluctuations around the mean field states can be described 
by amplitude and phase (i.e., orientational) deformations of 
the order parameter, and we obtain the collective mode spec- 
trum at the Gaussian level. In the continuum case, the phase 
mode is an overdamped Goldstone mode and the amplitude 
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FIG. 1: Imaginary part of the spin susceptibility at ti;/2t = 0.12. (a) 
3D plot of Imx shows strong amplitude anisotropy in the — qy 
plane near (vr, tt). (Inset) 2D plot of Imx- The incommensurability 
patten forms a "diamond" shape, (b) Line scans of Imx at different 
Qx values. The incommensurabilities are Sx = 0.08 and 5y — 0.07 
r.l.u. 



mode is gapped'^. In the lattice case, the nematic order is 
pinned to the underlying lattice, so the phase mode is also 
gapped. The form factors associated with the amplitude and 
phase fluctuations are F{k, q) and G{k, q) respectively.'^ 

In the following sections, we study the spin and charge 
susceptibilities in the d-wave superconducting state, which 
occurs on top of the nematic liquid with anisotropic disper- 
sion. The quasiparticle dispersion in the superconducting 



state is given by Ek = \/t^ + A^, with efc is the elec- 
tronic dispersion in the nematic phase given by Eq. 0, and 
Afe ~ Asc(cos kx — cos ky)/2 is the d-wave superconducting 
gap- 



Ill. DYNAMICAL SPIN SUSCEPTIBILITY 

To analyze the dynamical spin susceptibility, we employ the 
standard random phase approximation (RPA) at the exchange 
interaction and the quadrupole density interaction. Spin sus- 
ceptibility in RPA is given by 



(5) 



where J{q) = J{cosqx + cosqy)/2 is the exchange inter- 
action, and Xo is the susceptibility irreducible to J{q). Xq 
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includes the bare spin susceptibility as well as the coupling 
between the spin density and the collective modes of the ne- 
matic order, which can be written as— 



Xo — Xoo 



E 

a=l,2 



i + ^2(9)nj 



XOO + Xn ; 



(6) 



where Xoo ^ {[Sz, Sz])q is the bare spin susceptibility, V/ ^ 
{[Sz,SA% J)o, - {[S'A%^„ Sz])o represents the coupling 
between the spin density and the nematic order fluctuations, 
and ^ ([<^^^ z, z])o is the correlation between ne- 
matic order fluctuations. Here a = 1,2 corresponds to the 
amplitude and the phase mode, respectively, and A^r ^ — 
Aw.t ^ ^N.i- In the superconducting state, these quantities 
are given by the BCS-type expression assuming that the d- 
wave superconductivity is build on top of the nematic phase. 



k 



; 1 



f-k^k^ 



- 1- 



EkEk+q 
^k^k+q + AkAk+q 

EkEk+q 
^k^k+q + AkAk+q 



EkEi 



k-CJk+q 



f{Ek + q) - f{Ek) 

LO - {Ek+q - Ek) + iS 

1 - f{Ek + q) - fjEk) 
LU + {Ek+q + Ek) + i6 
f{Ek+q) + f{Ek) - 1 ' 

u - {Ek+q + Ek) + iS _ 



(7) 



where is the anisotropic dispersion given by Eq. @, = 
Asc{coskx — cosky)/2 is the d-wave superconducting gap, 
Ek = a/e^ + A^ is the quasiparticle energies, / is the Fermi 
function and M{k, q) are form-factors given by 



M{k,q) 



(1 
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For the bare electron dispersion, we use the tight-binding 
parameters in Ref. 19, given by i = 138meV, t' = —0.24^, 
and ^ = — 0.634t. The superconducting gap is Age — 
0.252t « 35meV. The choice of J = t gives the reso- 
nance at (tTjTt) = (0.5,0.5) reciprocal-lattice units (rl.u.) 
at rto ~ 0.29t « 40meV, corresponding to the resonance 
peak observed in optimally doped YBa2Cu306+K- We take 
the nematic order parameter. Am /'it — 0.1, temperature 
T/2t ^ 0.005 and 6/2t = 0.005 in the numerical calcula- 
tions. The momentum integrals are summed over a 512 x 512 
mesh in the Brillouin zone. We set the parameters in F2 (q) 
to be F2/2t = 0.49 and k = 1. This set of F2, /i, and Ajv 
satisfies the mean field equation of Eq (|3}- 

Figure [2 shows imaginary part of the RPA spin suscepti- 
bility at = 0.24t K, 33 meV, slightly below the resonance. 
A few important observations follow: first, the incommensu- 
rate peaks in the nematic state show clear anisotropy along 
(tt, -k ±6y) and {tt ±5x, tt) directions. In Fig.fQb), we show 
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FIG. 2: Energy contour plots for quasiparticle dispersion Ek and 
Ek+Q = uj/2 = 0.12t in d-wave superconducting state. Black 
and red curves are contour with An fit = 0, and Ajv/2t — 0.1, 
respectively. Red arrows are vectors with the same length. In the 
nematic phase, rotational symmetry is broken, so the nesting vector 
for the vertical shift is no longer a nesting vector for the horizontal 
shift. And the difference in the nesting areas (shaded areas) results 
in the amplitude anisotropy. 



several qy line scans at the different fixed qx values. The am- 
plitude of the incommensurate peaks is small initially along 
the qy direction and continues to grow until finally the ampli- 
tude becomes maximum along the qx direction. Second, the 
incommensurabilities are given by Sx — 0.08 and Sy ^ 0.07 
rl.u. The incommensurability pattern shows a diamond shape, 
slightly elongated along the qx direction which is the direc- 
tion of the elongated Fermi surface due to nematic ordering 
(Fig. n^a), inset). Third, there is a strong anisotropy in the 
width of the incommensurate peaks. The ratio between the 
full width of half maximum of the incommensurate peak at 
(0.42,0.5) and that at (0.5,0.43) is about 0.58. Finafly, the 
tendency of anisotropy in the incommensurate peaks depends 
on frequency. At higher frequencies, closer to the resonance 
mode, the anisotropy gets weaker, and disappears at the res- 
onance mode around 40 meV. These results bear a resem- 
blance to the magnetic scattering pattern observed in recent 
neutron scattering experiments in YBa2Cu306+a:^'"'''' How- 
ever, the locus of the maximum spectral weight shows ap- 
proximately circular shape in experimental data'", while we 
find a diamond-like pattern, which is similar to that found in 
Ref 19 based on the same set of parameters for the bare band 
structure. 

We find the major contribution of the anisotropy of ampli- 
tude and width of incommensurate peaks in the momentum 
space comes from the bare spin susceptibility Xoo due to the 
anisotropic band structure, while the contribution from the 
coupling to the collective modes, Xn negligible, because 
around q = {tt, tt), are small due to the form-factors. 

The anisotropy of the amplitude and incommensurability 
can be understood from the quasiparticle energy dispersion 

Ek- At low temperatures, we notice /mxoo ~ Sfe'^(^~-^k+ 
i?k+q) apart from the coherence factors. The major contribu- 
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tion of the incommensurability is due to the nesting between 
the energy contour around the node, Ey^ ~ uj/2 « 0.12t, to 
the same contour displaced by Q = (tt, tt), i?k+Q ^ w/2i2S 
The best nesting vector is horizontal or vertical offset to 
(tt, tt), at q = (tt ± S^, tt), (tt, tt ± 5y) = {tt, tt) + (5q.^' In 
Fig. 121 we plot the energy contours for Eu, i?k+Q = = 
0.12^ for the isotropic case (black curves) and the nematic 
case (red curves). For the isotropic dispersion, the horizontal 
and the vertical incommensurabilities are equal. On the other 
hand, for the anisotropic dispersion due to the nematic order- 
ing, the X ~ y rotational symmetry is broken and a preferred 
direction is selected. In Fig.|2] the vertical arrow corresponds 
to a nesting vector (5q = {Sy, 0), and the horizontal arrow cor- 
responds to the same vector, (0, 5x) rotated by 90°. However, 
with finite An, the vector {0,Sx) is no longer a nesting vector, 
which explains the locus of maximum spin spectral weight oc- 
curs at shghtly different incommensurate vectors, 6x and Sy. 
The nesting regions for the horizontal and vertical offset vec- 
tors (Fig.|2] shaded areas) become different due to the nematic 
order, which results in the pronounced anisotropy in the am- 
plitudes of the incommensurate peaks. 



IV. DYNAMICAL CHARGE SUSCEPTIBILITY 

To analyze the dynamical charge susceptibility, we em- 
ploy RPA at the quadrupole density interaction and on-site 
Coulomb interaction. Similar to the previous section, the 
charge susceptibility in RPA is given by 



x^iq,^) 



X5 



(9) 



where U = 2t is the on-site Coulomb interaction, and Xa is 
the susceptibility irreducible to U. Xo includes the bare charge 
susceptibility x^q, as well as the coupling between the density 
and the nematic order, which can be written as follows. 



Xo — Xoo 



a=l,2 ^ 



F2{q)Il-a 



Xoo + XaT: 



(10) 



where Xqo ^ {[PiP])o is the b^"e density susceptibility, 
- {[p, SA%])o, - {[SA%,p])o represent the coupling 

between the density and the nematic order fluctuations, and 
~ {[SNa,SNa])o the correlation between nematic order 

fluctuations. 

In the superconducting state, these quantities are given by 
the BCS-type expression assuming that the superconductivity 
occurs on top of the nematic phase. 
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FIG. 3: Imaginary part of the charge susceptibilities, (a) and (b) 
are plots of RPA susceptibilities Imx'^ in and qy directions with 
different \q\ values, (c) and (d) are the susceptibilities Imxo at 
q — (0, O.Itt), (O.Itt, 0) respectively. The contribution can be sepa- 
rated into Xoo, the susceptibility from the band structure and xn, the 
susceptibility from coupling to the nematic fluctuations. Xiv gives 
the contribution to the collective mode at lower energy, cu is in units 
oft. 



and the form-factors, AI {k, q) have the same definition as in 
Eq. (|H). 

We show in Fig. the imaginary part of the RPA charge 
susceptibilities x'^ in the {q^, 0) and (0, qy) directions at small 
momentum transfer q. There is a peak at low energy, and a 
broader spectrum at higher energies. We show the momen- 
tum dependence of Imx'^ along the {q^, 0) and (0, qy) direc- 
tions in Fig.|3ja) and (b). We find the peaks become narrower 
with the increase of |q|, and and a sharper peak emerges at 
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FIG. 4: The dispersion of the collective mode in (0, g)(black) and 
(g, 0)(red) directions. Shaded areas are the continuum of the ex- 
citations. The boundaries corresponds to the onset of Jmllf in 
(0, q)(black) and (q, 0)(red) directions, to is in units of t. 



around |q| w 0.047r. We see there is a clear difference for 
Ivny^ in the two directions of (g^:, 0) and (0, qy), which in- 
dicates the broken lattice rotational symmetry due to the ne- 
matic order To analyze the origin of the low energy peak, 
we plot in Fig. |3jc) and (d) xo> Xoo ™d xn separately at 
q — (0, O.Itt), (O.Itt, 0). The bare charge susceptibility, xoo 
contributes mainly to the broader spectrum at high energies 
with different spectral weights for (0,0. Ivr) and (0.l7r,0). 
The coupling of the density to the nematic order fluctuations 
provides a well-defined resonance peak at low energy, in addi- 
tion to the high energy spectrum. This corresponds to the am- 
plitude mode of the nematic fluctuations. Comparing Fig.|3Jc) 
and (d), the anisotropy between the wave-vectors, (0, O.Itt) 
and (O.Itt, 0) is manifested in the amplitudes of the resonance 
peak and the weight and shape of the high energy spectrum. 

To understand the dispersion relation of the amplitude 
mode, we summarize the dispersion of the mode in Fig. 0] 
The resonance frequency Wies is given by the peak posi- 
tion of Imy^ . The shaded areas correspond to a continuum 
of excitations and the boundaries are given by the onset of 
/mn^(q, lS). We find that the collective mode is overdamped 
in the small-q region, and becomes a well-defined mode at 
moderate q. We also see that when the mode becomes sharp, 
there exists a weak anisotropy in the resonance frequencies in 
the two different directions of momentum transfer, |q|. This 
sharp mode is the collective mode associated with the nematic 
order, so it can provide a direct observation for the nematic or- 
der in the real materials.— 



V. DISCUSSION 

The incommensurate spin susceptibility obtained from our 
calculation based on the idea of coexisting nematic and su- 
perconducting orders shows great similarities to the exper- 
imental magnetic scattering pattern reported in a recent in- 
elastic neutron experiment"*: while the basic character of 
spin excitations is two-dimensional, the amplitude and the 
width of the incommensurate peaks along the locus of max- 
imum spin spectral weight is modulated in a one-dimensional 



fashion. We find that at constant frequency scan, the am- 
plitude of the spectral weight is maximum at incommensu- 
rate wave-vector along g^^-direction (or qy, depending on the 
direction of the Fermi surface deformation due to the ne- 
matic order), and it continues to decrease to the wave-vector 
along gj,(g2;)-direction, as shown in Fig.Q] However, the ob- 
served incommensurate fluctuations approximately form a cir- 
cle (within the numerical convolution error bars) in the mo- 
mentum space, while our theoretical calculation shows incom- 
mensurate pattern of a diamond shape. This diamond shape 
feature is common to the theoretical models incorporating the 
RPA method>i2i22i2^ The anisotropy of the spectral weight de- 
pending on the direction in the momentum space originates 
from the anisotropic band structure of the electrons due to the 
formation of the nematic order. The contribution from the 
coupling to the nematic order fluctuations for a large momen- 
tum transfer near (tt, tt) is negligible. 

On the other hand, a collective mode at moderate energies 
for small momentum transfer q, is observed in the density 
fluctuations. Due to the opening of the superconducting gap, 
the space of particle-hole continuum at low energy is limited 
for nodal excitations. Therefore, the collective mode becomes 
sharp around \q\ w 0.04tt, while it is overdamped as (7 « 
shown in Fig.|3l The amplitude of this mode shows a strong 
anisotropy depending on the direction of the momentum trans- 
fer, reflecting the x ~ y symmetry breaking nature of the ne- 
matic order, but its dispersion depends weakly on the direction 
of the momentum transfer Since this is a well-defined mode 
and well separated from the high energy contributions from 
the band structure, it can be detected by the inelastic X-ray 
experiments or electron scattering. It also leads to the addi- 
tional signal in the optical conductivity at the frequency of 
collective mode. 

Another implication of the nematic ordering is the distor- 
tion of the underlying Fermi surface due to the formation 
of the nematic order Angle resolved photoemission spec- 
troscopy shows strong in-plane anisotropy in the electronic 
structure, as well as in the magnitude of the superconduct- 
ing gap.^"^ Our results suggest that the in-plane anisotropy of 
spin dynamics originates from the anisotropy of the hopping 
integrals. While the nematic order induces the hopping inte- 
gral anisotropy of tx/ty ^ 1.22 with the set of parameters 
we used, we cannot exclude another possible explanation of 
the orthorhombicity of CUO2 plane^^ and its connection to the 
CuO chain in YBa2Cu306+2:. According to the band theoryS^ 
the ratio between the hopping integrals along the x and y di- 
rections scales roughly as (6/a)^ which is at most 1.06 around 
optimal doping. We find that this ratio of tx/ty — 1.06 for 
only the nearest neighbor hopping integral can not produce the 
visible anisotropy in the spin dynamics of the d-wave super- 
conductor within RPA : tx/ty = 1.06 leads to a ratio of 1.1 
in the peak amplitudes between (0.42, 0.5) and (0.5, 0.43), 
while our set of parameters leads to the ratio of 2.3, which 
depends on the strength of F2 and /i. 

However, this is only a quantitative argument, and fur- 
ther studies, such as identification of the collective modes, 
are required to clarify the origin of anisotropy observed in 
the spin excitations. It would be also interesting to study 
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the doping dependence of the strength of anisotropy in the 
spin excitations. While the structural anisotropy (the ratio 
between the lattice constants, b and a) decreases as oxy- 
gen content decreases^^'^^, the tendency toward nematic or- 
dering gets stronger in the underdoped regime.^ Therefore, 
the strength of anisotropy in the magnetic scattering signal 
will either decrease or increase, depending on the origin of 
anisotropic hopping integrals: it gets stronger (weaker) if its 
origin is due to the nematic order (structural anisotropy), as 
the hole doping concentration decreases. While the exist- 
ing data with different doping concentrations "^ '^ indicates a 
stronger anisotropy in underdoped YBCO, a systematic study 
is necessary to determine the origin. Another clue may come 
from the study on the temperature dependence of the strength 
of anisotropy in the magnetic scattering pattern. Since the 
structural anisotropy does not depend on temperature (below 
700K)rithe strength of the anisotropy due to orthorhombicity 
depends weakly on temperature, only via thermal broadening 
and temperature dependence of the superconducting order pa- 
rameter. On the other hand, the anisotropy induced by the 
nematic order gets weaker as temperature increases,^- '■'•'^ and 
eventually disappears at the nematic-isotropic transition tem- 
perature. 

VI. SUMMARY AND CONCLUSION 

While the crystalline stripes have been observed directly 
in maganese oxide compounds via X-ray diffraction^, the ne- 
matic phase, which can be viewed as strongly fluctuating 
stripes, requires further theoretical and experimental studies to 
make direct connections to real materials such as high temper- 
ature superconductors.^ Here we have studied spin and charge 
susceptibilities in a superconducting phase whose underlying 
electronic dispersion is anisotropic due to the nematic order, 
and aimed to understand the effects of the nematic order on 
spin and charge excitations at the level of weak coupling the- 
ory. 

We consider a phase where d-wave superconducting order, 
Afe, occurs on top of the electronic nematic phase. The under- 
lying electronic dispersion, ik breaks the x — y symmetry, and 
the banana shape of energy contour for the superconducting 
quasiparticle Ek — \J ej. + is tilted due to the formation 
of the nematic order. An {ik = ffc + AAr(cos(fcj;) — cos(fcj^)). 
The standard RPA is used to compute the spin and charge sus- 
ceptibilities, where the irreducible susceptibility includes not 
only the bare one but also the coupling to the collective modes 



associated with the broken x — y symmetry in the nematic 
phase. 

Motivated by a recent neutron scattering experiment on de- 
twinned optimally doped YBa2Cu306+a~^ we study the spin 
excitations near the resonance mode, (tt, tt), and find that the 
amplitude and width of the incommensurate peaks, which ap- 
pear at a set of incommensurate wave vectors, |q|, at con- 
stant frequency below the resonance, depends on the direc- 
tion of the momentum transfer For example, a pronounced 
anisotropy in the amplitude of incommensurate peaks between 
(tt, tt ± Qy) and {n ± q^, tt) where w qy has been found, 
which shows close similarities to the magnetic scattering pat- 
tern observed in the neutron scattering experiment. Our anal- 
ysis shows that the main contribution of this anisotropy stems 
from the anisotropic band structure due to the nematic order. 
However, to clarify the origin of the anisotropic band disper- 
sion, further studies, such as temperature and doping depen- 
dence of the anisotropy in the signal strength, are required. 

In the charge channel, the coupling between the density and 
the collective modes shows a well-defined collective mode for 
small momentum transfer While this mode is overdamped 
due to the particle-hole continuum near q « 0, it becomes 
sharp as q increases, due to fact that the space of Landau 
damping is restricted to the small momentum for low en- 
ergy because of the opening of the superconducting gap. This 
mode can be detected by inelastic X-ray scattering, and may 
lead to additional signal in optical conductivity. 

It is interesting to note that the form-factors for the nematic 
fluctuations are very similar to those of the Raman vertices 
for the Big and i?2g channels, and thus the collective mode in 
the charge susceptibility will produce an additional Raman re- 
sponse in the particular channels. Also the coupling of the ne- 
matic fluctuations to the lattice degrees of freedom may result 
in some anomalous phonon responses. These are interesting 
questions and subjects of future studies. 
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